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^ , A linear-programming decoder for nonbinary expander codes is presented. It is shown that the 

• proposed decoder has the maximum-likehhood certificate properties. It is also shown that this decoder 

OO I corrects any pattern of errors of a relative weight up to approximately \SaSb (where Sa and Sb are 

■ the relative minimum distances of the constituent codes). 
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! I. Introduction 

^ . 

lO ■ Low-density parity check (LDPC) codes have become very popular in recent years due to 

^ J ! their excellent performance under message-passing (MP) decoders. Yet, our understanding of 
^ I LDPC codes and their decoders is still limited. While most of the research to date was devoted 
^ ■ to binary LDPC codes, there are works suggesting that nonbinary LDPC codes combined with 
O ■ high-order modulation schemes can possibly outperform their binary counterparts (at a price of 
j> I higher decoding complexity) [12], [18]. 

^ ■ For a binary case, a new approach toward understanding of LDPC codes was suggested in [4] 

■ and [7]: it was proposed to decode binary LDPC codes using linear-programming (LP) decoder, 
and important connections between the linear-programming decoding and the message-passing 
decoding were established (see also [11], [20]). In particular, it was shown that the events of 
LP decoder failures are caused by so-called pseudocodewords, and those pseudocodewords are, 
in turn, related to the failure events of the message-passing decoders. 

These results were generalized in [9], [10] toward nonbinary LDPC codes and coded mod- 
ulations, and in particular to codes over finite quasi-Frobenius rings. It was shown that the 
connections between LP decoding and MP decoding are preserved in the nonbinary settings as 
well. 
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A promising approach for constructing LDPC codes using graphs goes back to [19]. The 
construction was modified in [17], where expander graph was used as an ingredient in a 
construction of linear-time decodable codes that correct a constant fraction of errors under a 
variation of an MP decoder. This result was improved in the works [2], [3], [15], [16], [21]. It 
was shown in [1] that expander codes achieve capacity of a binary symmetric channel under a 
variation of MP decoder. Explicit constructions of regular expander graphs can be found, for 
instance, in [13], [14]. 

In [5], the performance of expander codes in [17] under the LP decoding was investigated. It 
was shown, that the LP decoder corrects a similar fraction of errors as the MP decoder in [17] 
does. This research direction was extended in [6], where it was shown that the expander codes 
achieve the capacity of a variety of binary memory less channels. It was also shown in [6], that 
the LP decoder applied to the codes in [21] corrects a similar fraction of errors as the decoder 
therein, which is approximately a quarter of the lower bound on their relative minimum distance. 

In this work, we generalize several results in [6] toward nonbinary settings. There are some 
additional differences between [6] and our work. First, we use a slightly different definition of 
a (bipartite) expander graph and corresponding code. Second, the analysis in [6] assumes that 
the all-zero codeword was transmitted. This, in turn, requires a symmetry assumption on the 
corresponding LP polytope. (Similarly, the analysis of nonbinary LP decoding in [9] and [10] 
also requires a symmetry condition on the modulation alphabet and the underlying modulation 
mapping, which results in the symmetry of the decoding polytope, see also [8].) In this work, 
we do not use the assumption that the all-zero codeword was transmitted. We consider the 
adversarial channel, and the proof does not assume any further conditions on the symmetry of 
the channel. Finally, we present a more accurate analysis of the correctable fraction of errors, 
and, in particular, we elaborate on the o(l)-term in the bound on a fraction of correctable errors. 

The manuscript is structured as follows. In Section [III we redefine (nonbinary) expander codes. 
In Section UlI] we define a linear-programming decoder for these codes and discuss some of its 
basic properties. In Section |IVl we present the dual problem and discuss the criteria for the 
decoding success. In Section |Vl we present a feasible solution to the dual problem and show 
that the LP decoder corrects a constant fraction of errors. In Section |Vll we present a concept 
of error pattern orientation. By using this concept, we show that the LP decoder corrects even 
higher fraction of errors. 



II. Code Construction 
Below, we revisit the construction in [1]. 

Let Q = {AVJ B , E) hQ di. bipartite A-regular undirected connected graph with a vertex set 

V = AVJB such that AnB = and an edge set E such that every edge has one endpoint in A 
and one endpoint in B. We denote \A\ = \B\ = n and thus \E\ = An. We assume an ordering 
on V, thereby inducing an ordering on E = {ej}[f ^. Let F be the field F^. For every vertex 

V G V, we denote by E{v) the set of edges that are incident with v. For a word z = {z^X^e 
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(whose entries are indexed by E) in Fl^l, we denote by {z)e(v) the sub-block of z that is indexed 
by E{v). 

For all V eV, let C{v) be linear codes of length A over F. The expander code C is defined 
as the following linear code of length over F: 

C = {c e FI-^I : (c)s(„) e C{v) for every veV} . 

Let Ca and Cb be linear [A, r^A, (5aA] and [A, r^A, 5bA] codes over F, respectively. In the 
sequel, we consider the code C with 



C(v) 



Ca for every v G A 
Cb for every v e B 



This code was first studied in [1]. In particular, it was shown therein that the rate of C is at least 

ta + tb - 1- 

Denote by Ag the adjacency matrix of Q; namely, Ag is a \V\ x \V\ real symmetric matrix 
whose rows and columns are indexed by the set V, and for every u,v eV, the entry in Ag that 
is indexed by {u,v) is given by 



. . _ r 1 if {u,v}eE 
{^g)u,v <y Q otherwise 



It is known that A is the largest eigenvalue of Ag. We denote by 7g the ratio between the 
second largest eigenvalue of Ag and A. The constructions of A-regular bipartite expander graphs 
in [13], [14] have ^g = 2^A^/A. 

The relative minimum distance of C, 6c, was shown in [15] to satisfy 

6aSb - IgVSaSb 



Sc > 
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In the sequel, we use the notation d{x, z) to denote the Hamming distance between the vectors 
X and z. 



III. Linear-programming decoder 

In this section, we introduce an LP decoder for the code C. Suppose that the codeword 
c = (ce)eeE £ C is transmitted through the adversarial channel and the word y — {ye)eeE £ IF''^' 
is received. 

We define the mapping 

i : F — >{0,1}«CK^ 

by 
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such that, for each a e F, 

1 if a = P 
otherwise. 



The mapping ^ is one-to-one, and its image is the set of binary vectors of length q with Hamming 

weight 1. Please note that this mapping is slightly different from its counterpart in [9], where 
the image of the mapping was the set of binary vectors of length q — 1 of Hamming weight 
or 1. 

We also define 
according to 

S(C) = (£(CeJ I ^(CeJ I ••• |£(Ce,,,)). 

We note that H is also one-to-one. 

For vectors / G M'^'^l, we adopt the notation 

f if ei \ f €2 \ ' ' ' \ f ^\E\^ ' 

where 

Ve eE, f,^ (/i"))„eF . 

We can write the inverse of H as 

Below, we define the variables that will be used in the decoder. For all e G -E. a G F, we use 
the variables /i"^ > 0. The objective function is ^eefi SaeF 7e"Vi"^ where 'je is a function 
of the channel output. 

For each a G F we set 

{a) _ / -1 if a = ye 



7e ' = 



1 if a 7^ ye 



Assume that = for some e G -B, /? G F. Then, it is straightforward to verify that 



(a) _ J -1 if /5 = l/e 



1 ifp^y, 



e 



Suppose now that f — E{z) for some z G Fl^L It follows that 



+ 1^1 =20(2/,;.). (1) 

eeE ae¥ 
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Maximize ^ {-li'"^) ■ /i"^ (2) 

eeE,a£¥ 

subject to \fv eV : ^ w^^b = 1 ; (3) 

beciv) 

Ve = {v, u}eE,^ae¥: ff^ = Yl ""-^^ ' 

b<^C{v) : be=a 

Ve G ^, a G F : > ; (6) 

WveV, be C{v) : > . (7) 

Fig. 1. Primal LP problem 



(Recall that the notation d{y, z) is used for the Hamming distance between y and z.) Therefore, 
finding z G C such that / = minimizes the left-hand side of ([T]) is equivalent to the 

maximum- likelihood decoding of y. Instead, however, we will equivalently maximize 

eS-E cjGF 



In the sequel, we use the variables w^^b for all f G V and all b G C{v). These variables can 
be viewed as relative weights of local codewords b associated with the edges incident with the 
vertex v. The corresponding linear-programming problem is presented in Figure [T] 

Constraints dS])-© form a polytope which we denote by Q. In particular, it follows from 
constraints ©-(E]) that 

VeGi? : 5^/(-) = l. (8) 

a6F 



Next, we define the decoding algorithm for the code C. The decoder optimizes the objective 
function ^ subject to constraints ©-(IT]). If the result / is in {0, l}"^'^', then the decoder outputs 
(as it is shown below, this output is then a codeword of C). Otherwise, the decoder 
declares a decoding failure. 

We have the following proposition. 

Proposition 3.1: 
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1) Let {f,w) G Q and / e {0, Ij^l^L Then 



S-^(/) E C . 



2) If c G C then there exists w such that (/, tu) G Q and / = E{c) G {0, Ij^l-^L 
Proof: 

1) Suppose (/, lu) G Q and / G {0, l}*?!^!. Let c = E'^f). By ©, c is well defined. Next, 
fix some V eV and let a = {c)e(^^) (for a = (ae)eeB(s;))- It follows that for any e G -E'(f), 
a G F, /i"-* = 1 if and only if Oe = a. Let d G C{v), d ^ a. Since a and d are different, 
there exists /? G F and e' G ) such that a^' 7^ /5 and de' = (3. Then, it follows from ([8]) 
and either from (H)) or from dS]) that 



and therefore = 0. 

It follows that Wy^d = for all d G C(f ), d 7^ a, and that w^^a = 1- Applying this argument 
for every v eV implies c G C. 
2) Assume that c G C. Let / = S(c). For each w G l^, we set 



It is straight-forward to verify that / G {0, Ij^l^l and the corresponding {f,w) is in Q. 

U 

The following theorem is an equivalent of the maximum-likelihood certificate. 

Theorem 3.2: Suppose that the LP solver applied to the LP problem in Figure [T] outputs a 
codeword c G C. Then, c is the maximum-likelihood codeword. 

The proof follows from the previous proposition and ([T]). 



We aim to show that the decoder succeeds given that the number of adversarial errors is 
bounded from above by a certain constant. We use the dual witness approach proposed in [5]. 
This technique was extended in [6] toward binary expander code. We further extend this technique 
toward nonbinary settings. 

Recall that the codeword c G C was transmitted. If that is the case, the decoder succeeds if it 
outputs the same c. It follows from Proposition 13.11 that there is only one feasible combination 
of values of the variables 5 that corresponds to the codeword c, namely 



= fj 



J2 




IV. Dual Witness and Unique Solution 
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Minimize 
subject to 



Ve = Kn}ei?, V«eF: ri J + r^") < 7^"^ 



(9) 

(10) 
(11) 



Fig. 2. Dual LP problem 



Ve = {v, u} EE, Mae ¥\{c,} : r^J + r^-) < 7^") ; (12) 

Ve = {t;, m} G E : t^"";^ + r^^,^) < 7^^ ; (13) 

Mv eV,ybe Civ) : Yl ^ --2^ + • (14) 

Fig. 3. Dual Polytope V 



The sufficient criteria for the decoder success is that this solution is the unique optimum of the 
LP decoding problem in Figure [U 

To prove the optimality, we show the existence of a dual feasible solution, such that the value 
of the objective function of the dual problem is equal to the value of the objective functions of 
the primal problem. The dual LP problem makes use of the following variables. For each a e¥, 
e E E, and v E V, such that v is an endpoint of e, there is a variable ri"-* . In addition, for each 
V eV, there is a variable a^. 

The dual LP problem is presented in Figure [21 We set the objective value to be \E\—2d(y,c). 
This can be achieved by setting, for all v eV, = |A — d{{y)E^^,f, (c)£;(„)). 

In order to show the uniqueness of the solution, we slightly modify the dual LP problem. More 
specifically, we enforce strict inequalities in (fTOl) . such that the corresponding dual polytope 
(denoted by V) becomes as in Figure [H 

The uniqueness of the solution for the primal LP problem now follows from the following 
proposition. 

Proposition 4.1: If there is a feasible point in the polytope V, then there is a unique 
optimum for the primal LP problem in Figure \T\ 
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Proof: First, it is straight-forward to see that any feasible point r = {Tv'^}}v(^v,e&E,a(i¥ in 

V is also a feasible point in the polytope in Figure [2] with = |A — d{{y)E(v), for all 

V E V. Then, it follows from ([1]) that (/, w) is an optimal solution for the primal problem in 
Figure [B where 

yeeE : f, = aCe) . 
Assume that (h, s) is another optimal solution for the LP problem in Figure [T] 
Inequality (fT2l) implies that 

(a) , (a) ^ (a) _ 
'v,e ' u,e — le ^ i 

for some small e > 0, for all e = {v,u} E E, a E F\{ce}. We define a new cost function 
7 = {le°'^}eeE,ae¥ the problcm in Figure [T] as follows: 

^ 1 7e"^ Otherwise 

Observe, that 

It follows that (/, w) is an optimal solution for the LP problem in Figure [T] under the cost 
function 7. 

Note that (/, w) corresponds to a codeword c, and so its entries are either or 1. Moreover, 
(/, w) 7^ (h, s), and so in particular f ^ h. Therefore, there must exist at least one e E E such 
that / 7^ hf,. For such e, due to ^ (with respect to he), there exists at least one P E ¥ such 
that fr = and hi^^ > 0. Therefore, 



c(a) 

V /e ; J 

eeE,ae¥ e£E,a£¥ eGE,a£¥ e£E,a£¥ 



and this makes a contradiction to the fact that (/, w) is an optimal solution to the primal problem 
under the cost function 7. The contradiction follows from the (false) assumption that there is 
more than one optimal solution for the original primal problem. ■ 



V. Correcting a Constant Fraction of Errors 

Recall that the word c = {ceX^E ^ C was transmitted and y = {VeXes £ 1^'^' was received. 
Suppose that Q = {AVJ B ^ E) is A-regular bipartite graph defined as in Section |IIl 

In this section, we will define a notion of error core. Building on that, we will show that 
if there is no error core in the graph Q, then the dual solution can be always found for the 
appropriate nonbinary LP decoding problem. 

Definition: The graph Q has an (Ca, CB)-error core (where C,a, Cb ^ [0, 1]) associated with the 
word y if there exists a subset of edges in error E' C {e E E : 7^ Ce} and two subsets of 
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vertices A' C A and B' C B such that A' U B' is the set of all the endpoints of the edges in E', 
and: 

. for any v G A': \{E{v) n ^'}| > C^A; 
. for any v G B': \{E{v) n E'}\ > CbA. 

Below, we inductively define the sets of vertices Vi (for i = 0,1, ■ ■ ■ ,t, where t will be defined 
later) and the sets of edges Ei (for i = 1,2, ■ ■ ■ ,t) as follows. 

Basis. The edge set Ei will be the set of all edges corresponding to the erroneous symbols 
in y, and the vertex sets Vq and Vi will be the endpoints of edges in Ei. 



Ve 7^ Ce} ; 

E{v) n El ^ 0} ; 

E{v) n El ^ 0} . 



El = {ee E 
Vo = {veA 

Vi = {veB 
Step. For i > 2: 

Vi = {ve Vi^2 : |{e G E{v)nE^^i}\ > I^a} 
where 5 = 5^ if i is even, and 6 = Sb ii i is odd, and 



Ei 



|e = {v,u} G Ei^i : v G Vi-i, u E Vi^ . 



Lemma 5.1: If Ej = for some finite i, then the decoder in Figure [U succeeds. 

Proof: We show that the decoder succeeds by constructing a feasible point in the polytope 
V. We use e > to denote the quantity, which can be made as small as desired. The precise 
value of e will be discussed later. We set the variables ri"'' as follows. 

• Let e = {v,u] ^ Ei. Then, by definition of Ei, = ye- Assume that Ce = P. We set, 
ri? = rg^ = -1/2, and so rij + ri? < ^i^'^ = -1. We also set rij = rfi = 1/2 - e for 
all a G ¥\{(3}. In that case, rij + rij < 7^°^ = 1. Therefore, ^ and ([H are satisfied. 

• Let e = {v,u} G Ei. Denote Ce = p. By definition of Ei, 7^ Cg. Let i* be the value 
such that e G Ei*\Ei*^i. In addition, without loss of generality assume that v G Vj.-i and 
u G V^i* (and so v ^ V^.+i and |E(t;) n Ej.] < ^SA). 

Then, we set ri(^i = ri'^} = i In that case, t^^J + t^^I < 7!^^ = 1, and so CI) is 
satisfied. We also set, for all a G F\{/3}, ri"-* = — | — e and r^fi = |, which yields 
rij + rl5 < 7^^ G {-1, 1}. Thus, all inequalities CH) are also satisfied. 

Table U summarizes the assignments of the values to variables ri^"* for all e G E, w G e and 
a G F. 

Since Ej = for some finite i (we set t = i + 1, where i is this value), the values of all the 
variables ri"'' are defined. We already showed that all inequalities (fT2)) and (fT3l) are satisfied. 
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a = Ce 


a / Ce 


j/e is correct 


^(") _ 1 

lv,e — 2 


'ii,e — 2 


ye is in error 


^(a) _ 1 


(a) 5 (a) _ 3 

"^v . e ^ £ or Tu , e — 2 

depends on the structure of the error 



TABLE I 

Assignments of the values to the variables ri"i. 



Next, we show that inequalities (|T4l) are satisfied. It will be enough to show that for all v E V, 

b e C{v), 



J2 Ti':^>-'^A + d{{yU^„{cU^, 

e<^E{v) 



(15) 



For a vertex v E V and a codeword b E C{v), we define five sets of indices (edges) as follows: 



£1 = {eE E{v 

£2 = {eEE{v 

^3 = {eEE{v 

£'^ = {eE E{v 

£'l = {eEE{v 



He is correct and feg = Ce} , 
is correct and b^. ^ c^} , 
ye is in error and be = Ce} , 
ye is in error, be ^ Ce and r^^g^-* = ~i ~ ^1 
ye is in error, be 7^ and r^^Jf^ = §} • 



(These sets depend on v and b, in addition to their dependence on c and y. However, we write 
£j rather than £j{v, b) for the sake of simplicity.) 



Then, 



(be) 
v,e 



{be) 

v,e 



E + E + E + E + E 

eeEi e££2 egfa eG£^ ee£:^' 

EH) + E(i-^) + El + E(-l-^) + E 



> ( -iA + d((?/),,„„(c; 



i3(i,). 



E(i-^) + E(-3-^) + Ei- 



eG£:2 



In order to prove (fTSl) . it will be enough to show that 

1^2! + i^^n >3i^:i+e(i^2i + 1^11 



(16) 
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We observe several cases. 

. Consider a vertex v e {A\Vo) U iB\Vi). 
Then, 

'{e G E{v) : ye^Ce}\ = l^sl + Kl + \£'I\ = , (17) 

and so (fT6l) is satisfied for any e < 1. 
• Consider a vertex v & Vq U Vi. Let 5 = 5^ if £ and 5 = 5^ if G B. Since Ei = % 
for some i G N, we have that f G Vi*-i\Vi*+i for some i* G N. Therefore, 

\E{v)f}Ei* \ < \5A . 

We can write, with respect to this v and any 6, that 

|^^|<i(5-6')A, 

or, 

5A > 4|^^| + e'A , (18) 

for some small e' > 0. 

- If 6 = {c)e(^), then obviously \82\ = \£!i\ = \£!l\ = 0, and so (fT6l) holds. 

- If 6 7^ then recall that the minimum distance of C{v) is at least 6. Therefore, 
l^al + 1^4! + \£i \ > SA, and by using ([H]): 

+ ><5A-|^II > 31^11+ e'A. 

We see that holds for all e < e'. 

We have shown that that in all cases, for sufficiently small e, (fT4l) holds, and therefore there 
exists a feasible point in P. ■ 

Lemma 5.2: If there is no {\5a, |5B)-error core, then Ei = % for some i G N. 

Proof: Suppose that there is no i G N such that Ei = 0. Since for all i G N, Ei+i C Ei, we 
have that there exists some even i* G N, such that for any i > i*, Ei+i = Ei ^ This, in turn, 
means that Vi*+2 = Vi* and Vj*+3 = V^.+i. However, this implies (without loss of generality) 
that every v G V^j-+i and u G l^j*+2 has at least |5aA and ^5bA incident edges in -Ej.+i, 
respectively. It follows that the set of edges -E'i*+i together with the sets Vi* and Vi*+i forms a 
(i^A, |5i?)-error core. ■ 

Corollary 5.3: If the LP decoder in Figure [U fails, then there exists an (|^a, |'^B)-error 
core associated with the word y in the graph Q. 

The proof follows immediately from Lemmas 15.11 and 15. 2[ 
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VI. Using Error Pattern Orientation 



Let Q = {A U B, E) he. a A-regular bipartite graph as before. Let H = {Ua U Ub-^) be a 
subgraph with Ua'^A, Ub'^B and (B C E. For a vertex v e Ua^^ Ub denote by dcg-^(t;) its 
degree in the graph H. We start with the following known result. 

Proposition 6.1: Let Ua and C/b be subsets of sizes \Ua\ = and \Ub\ = b|i?|, 
respectively, such that a + b > 0. Let 6 be the edge set induced by the vertex set Ua^Ub, and 
denote H ^ {UaUUb,<B). Then, 

2|e|= deg^(T;) < 2 (ab + -fgy/a{l - a)b(l - b)) An 

< 2((l-7g)ab + 70V^)An . (19) 

This proposition is equivalent to Proposition 3.3 in [15]. The first inequality is obtained when 
the tighter inequality in Lemma 3.2 is used in the proof of Proposition 3.3 in [15]. If the graph 
is a Ramanujan expander as in [13], [14], then for fixed a and b, by increasing A (and so by 
reducing 7g), it is possible to make |C|/(An) as close to (ab) as desired. 

Definition: The assignment of the directions to the edges of the subgraph H = (Ua U f/^, (£) 
is called an [pA, PB)-orientation (for some Pa, Pb G (0,1]) if each vertex v e Ua and each 
vertex v E Ub has at most p^A and p^A incoming edges in (£, respectively. We will say that 
for the given assignment of the edge directions, M edges are violating the [p a, Ps) -orientation 
property at the vertex v e Ua (v G Ub) v has at most p^A + M {pB^ + M, respectively) 
incoming edges in (t. We will also say that for the given assignment of the edge directions, M 
edges are violating the [p a, Pb) -orientation property in H if M is the smallest integer such that 
by removing M edges from ^, the resulting V, will have a (p^, PB)-orientation. 

Lemma 6.2: Let H = [Ua Li Ub, <£) be a subgraph of ^ = [Au B,E) with Ua Q A, 
Ub Q B and e C E. Assume that 

|g|<^^^'"' -'--v^-An, 
1-76 

for some pa, Pb ^ (0, 1], such that 7g < ^/]IAPB, and |paA, |pbA are both integers. Then, 6 
contains an (p^/2, pB/2)-orientation. 

Proof: Assign directions to the edges in € such that the number of violations of an 
(p^/2, pb/2) -orientation in H is minimal. We will show that if for some v G Ua (v E Ub) 
there are more than pa/'^ (a*b/2, respectively) incoming edges, then it is possible to change 
the directions of the edges in the graph such that the number of edges violating the orientation 
property will decrease. This will make a contradiction to the minimality of the number of 
orientation violations in the current assignment of the edge directions. 

Denote by degj^v) the number of incoming edges (in W) of the vertex v. Recall that pa^ 
and pbA are even integers. We will use the following definitions. 

Definition: A vertex v e Ua^Ub is called a heavy vertex if it satisfies one of the following: 
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1) V eUA and deg^^iv) > ^/xaA; 

2) V E Ub and deg^^{v) > l/i^A. 

Definition: A vertex v E UaI^ Ub is called a full vertex if it satisfies one of the following: 

1) V eUa and deg^^iv) = ^/xaA; 

2) V eUb and deg-^^{v) = \ij,b^- 

Definition: A vertex f G f/yi U f/^ is called a Zz'^/z? vertex if it satisfies one of the following: 

1) V eUa and degi„(t;) < ^/xaA; 

2) V eUb and degin(i;) < |/iijA. 

Observe that the orientation property is not violated at the full and at the light vertices. Assume, 
by contrary, that there exists a heavy vertex in Ua^Ub- We show that it is possible to change 
the directions of the edges in € such that the total number of edges violating the orientation 
property in H will decrease. 

Define a set of vertices U to be the maximal set as follows: 

• If f G f/4 U f/^ is heavy then v E U. 

• If ?i G f/4 U f/fi is full and there is a direct edge from n to f for some v E U, then u E U. 
The set U is well defined. 

If there is an edge (w, u) for some w ^ U and u E U, then w is light and there exists a 
path from w to some heavy vertex v E U (vertex u can be full). Then, it is possible to flip 
the directions of all edges in the path, and thus to decrease the number of violations of the 
orientation property by 1 (at the vertex v). 

Below, we assume that there is no edge (w, u) for any w ^ U and u E U. Denote f/^ = f/nf/4 
and U'^ = U n Ub- Let (B' be a set of edges in (E having one endpoint in and one endpoint 
in U'b- Let a = lU'^l/n and b = If/^l/n. We have 

i(a/iA + h^^B)An < < |S| < ^-^^^ ' ^^vTw . ^^0) 

1 - 7g 

where the first inequality is correct since there are only heavy and full vertices in f/^ U f/^, and 
the last inequality is given by the conditions of the lemma. 

Assume that the ratio between the number of edges in from [7^ to U'b and the number of 
edges in (£' from U'b to f/^ is k > 0. Then, 



and 



ia/iA(l + k) ■ An <\(B'\ < (^(1 - 7g)ab + -fgVab^ An , (21) 

|b^ij(l + 1/k) ■An<\€'\< (^(1 - 7g)ab + 7gv^) An , (22) 

where the left-hand side inequalities follow from the fact that every vertex in U'^ and every 
vertex in U'b is either full or heavy, and the right-hand side inequalities follow from (fT9l) . 
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Inequalities UM and ^) yield 



b > 



2(1 - 7g) 1 - 7g V a ' 

and 

a > 



2(1 -7g) l-7gVb 
respectively. 

Consider two cases. 

Case 1: ^fiAi^ + > ^I^b{^ + I/'*)- Then, from (l23l) we have 



^ ^ /iA(l + K,) 7g / yUA(l + 



2(1 -7g) l-75\/^^(l + l/«:) 
and, so, 

2 1 - 7g 1 - 7g 



Finally, 



1 + 1/k /i^/iij(l + l/K) 7g //mRb 



1 + K - 2(1 -7e) l-7g 
Case 2: ayU^(l + k) < hfiB{l + l//^)- Then, from (|24|) we have 



/iB(l + 1/ft:) _ 7g / /ii3(l + 1/k) 
2(l-7g) l-7sV + 

and, so. 



2(i--„) T3^V~- 

We also obtain: 

1 + /iA/iB(l + k) 7g , 

1 + l/K 2(1 - 7g;) 1 - 7e; 

From (|20|) . in both cases we have: 

|€| > i(a;UA + b/iB)An 

2 \ 2(1 - 7g) 1 - 7g 

Denote 
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Observe that the right-hand side of (|25|) is a quadratic function of r]. Since 7g < ^/J^AJJ^, we have 
that this function is nonnegative and monotonic increasing for r] > / ^JJTaPb- Its minimum 
is obtained for the smallest value of rf, which is achieved at k = 1. Therefore, (|25] ) becomes 



We obtained a contradiction to the right-hand side of (l20l) . 

The contradiction follows from the assumption that there exists a heavy vertex in Ua^Ub, 
and it is impossible to flip the directions of the edges such that the number of violations of the 
orientation property will decrease. We conclude that there is an (;Ua/2, /iB/2)-orientation in (£. 

■ 

Define the numbers 6a and 6b as follows. Let > > 0) be the largest number such 
that 6a < 5a (6b < ^b) and \6a^ (j6bA, respectively) is integer. 

The following theorem is the main result of this paper. 

Theorem 6.3: Let C be defined as above, and assume that 7g < | V^a^b- Then, the decoder 
in Figure \T\ is able to correct any error pattern of a size less than or equal to 

0a(^b — ^^IgV^A^B . 
4(1-7.) ^" 

in a codeword c G C. 

Proof: Let (E be the set of edges in error (for a received word y), and assume that 



1^1 , 6a6b — '1'^q\/6a6b . 
\t\ < : ■ An . 

' 4(1 -7g) 

Then, by Lemma \62\ there exists an 6'B/4)-orientation of (£. 

Therefore, we are able to construct a feasible solution for the dual LP problem, as follows. 

• For the edges e ^ (3, we set the values of Tv'^J in the same way as we set the values of Tv"J 
for e ^ El in the proof of Lemma 15.11 

• For the (directed) edge {u, v) E (S, we set 



Va e F\{ce} : r^J = -| - e and ri^] = | , 



^(Ce) _ _(Ce) _ 1 

' u,e v,e 2 ' 



and 



These settings clearly satisfy all the constraints (1121) and (1131) . Moreover, since for every 
V E A {v E B) there are less than \5a^ (^^bA, respectively) incident edges e G € with the 
corresponding ri""* = — | — e, using the same argument as in Lemma [STTl for e small enough, 
we have that (fT4l) is also satisfied. ■ 
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